HRTransNet: HRFormer-Driven Two-Modality Salient Object Detection
نویسندگان
چکیده
The High-Resolution Transformer (HRFormer) can maintain high-resolution representation and share global receptive fields. It is friendly towards salient object detection (SOD) in which the input output have same resolution. However, two critical problems need to be solved for two-modality SOD. One problem fusion. other HRFormer output's To address first problem, a supplementary modality injected into primary by using optimization an attention mechanism select purify at level. solve second dual-direction short connection fusion module used optimize features of HRFormer, thereby enhancing detailed objects proposed model, named HRTransNet, introduces auxiliary stream feature extraction modality. Then, are beginning each multi-resolution branch. Next, applied achieve forwarding propagation. Finally, all with different resolutions aggregated intra-feature inter-feature interactive transformers. Application model results impressive improvement driving SOD tasks, e.g., RGB-D, RGB-T, light field SOD.https://github.com/liuzywen/HRTransNet
منابع مشابه
Salient Object Detection: A Survey
Detecting and segmenting salient objects in natural scenes, also known as salient object detection, has attracted a lot of focused research in computer vision and has resulted in many applications. However, while many such models exist, a deep understanding of achievements and issues is lacking. We aim to provide a comprehensive review of the recent progress in this field. We situate salient ob...
متن کاملSalient Object Detection and Segmentation
Automatic estimation of salient object regions across images, without any prior assumption or knowledge of the contents of the corresponding scenes, enhances many computer vision and computer graphics applications. We introduce a regional contrast based salient object extraction algorithm, which simultaneously evaluates global contrast differences and spatial weighted coherence scores. The prop...
متن کاملImprovised Salient Object Detection and Manipulation
In case of salient subject recognition, computer algorithms have been heavily relied on scanning of images from top-left to bottom-right systematically and apply brute-force when attempting to locate objects of interest. Thus, the process turns out to be quite time consuming. Here a novel approach and a simple solution to the above problem is discussed. In this paper, we implement an approach t...
متن کاملWeakly Supervised Learning for Salient Object Detection
Recent advances of supervised salient object detection models demonstrate significant performance on benchmark datasets. Training such models, however, requires expensive pixel-wise annotations of salient objects. Moreover, many existing salient object detection models assume that at least a salient object exists in the input image. Such an impractical assumption leads to less appealing salienc...
متن کاملSalient object detection: From pixels to segments
In this paper we propose a novel approach to the task of salient object detection. In contrast to previous salient object detectors that are based on a spotlight attention theory, we follow an object-based attention theory and incorporate the notion of an object directly into our saliency measurements. Particularly, we consider proto-objects as units of the analysis, where a protoobject is a co...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Circuits and Systems for Video Technology
سال: 2023
ISSN: ['1051-8215', '1558-2205']
DOI: https://doi.org/10.1109/tcsvt.2022.3202563